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(57) Abstract 



In compression encoding of a digital signal, such as MPEG2, transform coefficients are quantised widi the lower bound of each 
interval being controlled by a parameter A. In the MPEG2 reference coder, for example, A=0.75. Because the quantised coefficients are 
variable length coded, improved quality or reduced bit rates can be achieved by controlling A so as to vary dynamically the bound of each 
interval with respect to the associated representation level. The parameter A can vary with coefficient amplitude, with frequency, with 
quantisation step size. In a transcoding operation, A can also vary with parameters in the initial coding operation. 
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DIGITAL SIGNAL COMPRESSION ENCODING WITH IMPROVED QUANTISATION 

This invention relates to the compression of digital video, audio or 
other signals. 

Compression encoding generally involves a number of separate 
techniques. These will usually include a transformation, such as the block- 
5 based discrete cosine transform (OCT) of MPEG-2; an optional prediction 
step: a quantisation step and variable length coding. This invention is 
particularly concemed in this context with quantisation. 

The quantisation step maps a range of original amplitudes onto the 
same representation level. The quantisation process is therefore irreversible. 
10 MPEG-2, (in common with other compression standards such as MPEG-1 , 
JPEG, CCITT/ITU-T Rec.H.261 and ITU-T Rec.H.263) defines representation 
levels and leaves undefined the manner in which the original amplitudes are 
mapped onto a given set of representation levels. 

In general temis, a quantizer assigns to an input value, which may be 
15 continuous or may previously have been subjected to a quantisation process, 
a code usually selected from quantization levels immediately above and 
immediately below the input value. The error in such a quantization will 
generally be minimised if the quantization level closest to the input value is 
selected. In a compression system, it is further necessary to consider the 
20 efficiency with which respective quantization levels may be coded. In variable 
length coding, the quantization levels which are employed most frequently are 
assigned the shortest codes. 

Typically, the zero level has the shortest code. A decision to assign a 
higher quantization level, on the basis that it is the closest, rather than a lower 
2 5 level (and especially the zero level) will therefore decrease coding efficiency. 
In MPEG2. the overall bit rate of the compressed signal is maintained 
beneath a pre-detemnined limit by increasing the separation of quantization 
levels in response to a tendency toward higher bit rgtg. Repeated decisions 
to assign quantization levels on the basis of which is closest, may through 
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coding inefficiency thus lead to a coarser quantization process. 

The behaviour of a quantizer in this respect may be characterised 
through a parameter X which is arithmetically combined with the input value, 
with one value of X (typically X = 1) representing the selection of the closest 
5 quantization level or "rounding". A different value of X (typically X-0) will in 
coritrast represent the automatic choice of the lower of the two nearest 
quantization levels, or "truncating". In the MPEG2 reference coder, an 
attempt is made to compromise between the nominal reduction in error which 
is the attribute of rounding and the tendency toward bit rate efficiency which is 
10 associated with truncating, by setting a standard value for XofX- 0.75. 

Whilst particular attention has here been paid to MPEG2 coding, 
similar considerations apply to other methods of compression encoding of a 
digital signal, which including the steps of conducting a transformation 
process to generate values and quantising the values through partitioning the 
1 5 amplitude range of a value into a set of adjacent intervals, whereby each 
inten/al is mapped onto a respective one of a set of representation levels 
which are to be variable length coded, such that a bound of each interval is 
controlled by a parameter X. The transfomiation process may take a large 
variety of forms, including block-based transfomns such as the DOT of 
20 MPEG2. and sub-band coding. 

It is an object of one aspect of the present invention to provide an 
improvement in such a method which enables higher quality to be achieved at 
a given bitrate or a reduction in bitrate for a given level of quality. 

Accordingly, the present invention is in one aspect characterised in 
25 that X is controlled so as to vary dynamically the bound of each interval with 
respect to the associated representation level. 

Suitably, wherein each value is arithmetically combined with X. 
Advantageously, X is : 

a function of the quantity represented by the value; 
30 where the transfomiation is a OCT, a function of horizontal and 

vertical frequency; 
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a function of the quantisation step size; or 
a function of the amplitude of the value. 
In a particular form of the present invention, the digital signal to be 
encoded has been subjected to previous encoding and decoding processes 
5 and X is controlled as a function of a parameter in said previous encoding and 
decoding processes. 

In a further aspect, the present invention consists in a (q, X) quantiser 
operating on a set of transform coefficients xr representative of respective 
frequency indices fk in which X is dynamically controlled in dependence upon 
10 the values of xr and fk. 

Advantageously. X is dynamically controlled to minimise a cost function 
D + jiH where D is a measure of the distortion introduced by the quantisation 
in the uncompressed domain and H is a measure of compressed bit rate. 

The invention will now be described by way of example with reference 
15 to the accompanying drawings, in which:- 

Figure 1 is a diagram illustrating the relationships between 
representation levels, decision levels and the value of K 

20 Figure 2 is a block diagram representation of the quantization process 

in the MPEG2 reference coder; 

Figure 3 is a block diagram representation of a simplified and improved 
quantization process; 

25 

Figure 4 is a block diagram representation of the core elements of 
Figure 3; 



30 



Figure 5 is a block diagram representation of a quantization process 
according to one aspect of the present invention; and 
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Figure 6 is a block diagram representation of a quantization process 

according to a further aspect of the present invention. 

In the specifically mentioned compression standards, the original 

amplitude x results from a discrete cosine transform (OCT) and is thus related 
5 to a horizontal frequency index W and a vertical frequency index W Whilst 

this approach is taken as an example in what follows, the invention is not 

restricted in this regard. 

In general, a quantiser describes a mapping from an original amplitude 

X of frequencies W and W onto an amplitude y = Q(x). The mapping 
10 performed by the quantiser is fully determined by the set of representation 

levels {r{} and by the corresponding decision levels (dH as illustrated in 

Figure 1 . All original amplitudes in the range di<x< d(M) are mapped onto 

the same representation level y = Q(x) = r,. As can be seen from Figure 1 . 

consecutive decision levels are related by the quantisation step size q: and 
15 for a given representation level r/, the corresponding decision level is 

di.i ^ di q (1) 

calculated as: 

rf/ = r/ - y . 9 (2) 

20 The quantiser is fully specified by the quantisation step-size q and the 

parameter k for a given set of representation levels {rt}. Therefore, a 
quantiser that complies with equations (1) and (2) can be refenred to as a 
(q,A.) quantiser 

Currently proposed quantisers, as described in the reference coders 
25 for the H.261, H.263, MPEG-1 and MPEG-2 standards, all apply a special 

type of (q, X) quantiser in that a fixed value of X is used: for example X = 0.75 
in the MPEG-2 reference coder or X = 1.0 in the MPEG-1 reference coder for 
quantisation of intra-DCT-coefficients. 

According to one aspect of this invention, X is not constant but is a 
30 function that depends on the horizontal frequency index W. the vertical 
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frequency index fver, the quantisation step-size q and the amplitude x: 

^ = Mfkor* f.cr* q*X) (3) 

5 

Examples of ways in which the function may usefully be derived to improve 
picture quality in video compression at a given bit-rate - or to reduce the 
required bit-rate at a given picture quality - will be set out below. 

The invention extends also to the case of transcoding when a first 

10 generation amplitude yi = Qi(x) is mapped onto a second generation 

amplitude yi = QiiYi) to further reduce the bit-rate from the first to the second 
generation without having access to the original amplitude x. In this case the 
first generation quantiser Qf and the second generation quantiser Qz^xe 
described as a (qi, A.i)-type quantiser and a (qz, ^^l-type quantiser, 

15 respectively. The second generation A.2 value is described as a function: 



^2 = ^lifhor* fyer* ^2,r^ * V l) (4) 

20 

The parameter X2,ref that appears in Eqn. (4) is applied in a reference 
(qii ^2.re«)-type quantiser. This reference quantiser bypasses the first 
generation and directly maps an original amplitude x onto a second 
generation reference amplitude yi^ef^ Q2,ref(x). 

25 The functional relationship of Eqn. (4) can be used to minimise the 

error (y^ - y2,ref) or the error (y2 - x). In the first case, the resulting second 
generation quantiser may be called a maximum a-posteriori (MAP) quantiser. 

In the second case, the resulting second generation quantiser may be called 
a mean squared error (MSE) quantiser. Examples of the second generation 

30 (q2, ^2,M/i/»>type and (q2, X^^Mse^-type quantisers are given below. For a more 
detailed explanation of the theoretical background, reference is directed to 
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the paper "Transcoding of MPEG-2 intra frames" - Oliver Werner - IEEE 
Transactions on Image Processing 1998, which vyill for ease of reference be 
referred to hereafter as "the Paper". A copy of the Paper is appended to 
British patent application No. 9703831 from which the present application 
claims priority. 

The present invention refers specifically to quantization of 'intra' DCT 
coefficients in MPEG2 video coding but can be applied to non-intra 
coefficients, to other video compression schemes and to compression of 
signals other than video. In MPEG2, the prior art is provided by what is 
known as Test Model 5 (TM5). The quantization scheme of TM5 for positive 
intra coefficients is illustrated in Figure 2. 

In order to simplify the description, the above diagram will be replaced 
by Figure 3, which illustrates essentially the same quantizer except for small 
values of q, where it corrects an anomaly as described in the Paper. 

In this quantizer, the incoming coefficients are first divided by quantizer 
weighting matrix values, W, which depend on the coefficient frequency but 
which are fixed across the picture, and then by a quantizer scale value q 
which can vary from one macroblock to the next but which is the same for all 
coefficient frequencies. Prior to the adder, the equivalent inverse quantizer 
reconstnjction levels are simply the integers 0. 1, 2 ... . A fixed number X/2 , 
is then added to the value and the result truncated. The significance of X is 
that a value of 0 makes the quantizer (of the value input to the adder) a 
simple truncation, while a value of 1 makes it a rounding operation. In TM5, 
the value of X is fixed at 0.75. 

Attention will hereafter be focused on the operation of the 'core' 
quantizer shown in Figure 4. 

In a class of MPEG-2 compatible quantisers forjntra frame coding, 
non-negative original dct-coefficients x ( or the same coefficents after division 
by weighting matrix values W) are mapped onto the ;epresentation levels as: 
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y = Q(x) = L- + jj . e (5) 



The floor function ZaVextracts the integer part of the given argument a. 



5 Negative values are mirrored: 



y = -Q(\A) (6) 

The amplitude range of the quantisation step-size q in eq. (1) is 
10 standardised; g has to be transmitted as side infomiation in every MPEG-2 bit 
stream. This does not hold for the parameter X in eq. (1). This parameter is 
not needed for reconstructing the dct-coefficients from the bit stream, and is 
therefore not transmitted. However, the X-value controls the mapping of the 
original dct-coefficients x onto the given set of representation levels 

15 

rt = l.q (7) 
According to eq. (1), the (positive) x-axis is partitioned by the decision 

levels 



20 



25 



q 1^12 (8) 



Each X e [ d|, d i+i ) is mapped onto the representation level y = r/. As 
a special case, the interval [0, di ) is mapped onto y = 0. 

The parameter X can be adjusted for each quantisation step-size q, 
resulting in a distortion rate optimised quantisation: the mean-squared-en-or 

D = E[(x-yf] (9) 



is minimised under a bit rate constraint imposed on the coefficients y. In 
order to simplify the analysis, the first order source entropy 
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'Pi, log, Pr (10) 
of the coefficients y instead of the l\/IPEG-2 codeword table is taken to 
calculate the bit rate. It has been verified in the Paper that the entropy H can 
5 be used to derive a reliable estimate for the number of bits that result from the 
MPEG-2 codeword table. In Eqn. (10). Pi denotes the probability for the 
occurrence of the coefficient y=r/.^ 

The above constrained minimisation problem can be solved by 
applying the Lagrange multiplier method, introducing the Lagrange 
10 multiplier \i. One then gets the basic equation to calculate the quantisation 
parameter X: 

dD dH 

15 Note, that the solution for X that one obtains from Eqn, (1 1) depends 

on the value of |i. The value of ^ is determined by the bit rate constraint 



H < Ho (12) 

20 

where Hq specifies the maximum allowed bit rate for encoding the 
coefficients y. In general, the amplitude range of the Lagrange multiplier is 
0 < jj < 00. In the special case of Hq «, one obtains m 0. Conversely for 
Ho 0, one obtains In general jj ao. 

2 5 The Laplacian probability density function (pdf) is an appropriate model 

for describing the statistical distribution of the amplitudes of the original dct- 
coefficients. This model is now applied to evaluate analytically Eqn. (11). 
One then obtains a distortion-rate optimised quantiser characteristic by 
inserting the resulting value for X in eq. (5). 

30 Due to the symmetric quantiser characteristic for positive and negative 
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amplitudes in Eqns. (5) and (6), we introduce a pdf p for describing the 
distribution of the absolute original amplitudes The probability Po for the 
occurrence of the coefficient y = 0 can then be specified as 

5 . Po = \ p(x)dx (13) 

0 

Similarly, the probability P/ for the coefficient |y| becomes 

?/ = j p(x)dx I = 1.2, (14) 

With Eqns. (13) and (14), the partial derivative of the entropy « of eq. 
10 (1 0) can be written after a straightfooA^ard calculation as 

From eq. (9) one can first deduce 



15 



i)= \ J? . p(x)dx J (x-lqf .p(x)dx (16) 

0 

and further from eq. (16) 



no 

20 

It can be seen from eq. (17) that 



(17) 



dD 

— >0 ifO<,X<,l (18) 
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Thus, when X is increased from zero to one. the resulting distortion D 
is monotonically decreasing until the minimum value is reached for X^l. 
The latter is the solution to the unconstrained minimisation of the mean- 
5 squared-error, however, the resulting entropy H will in general not fulfil the bit 
rate constraint of eq. (12). 

Under the assumption of P/ > Pm in eq. (15), we see that ^/dk>^. 
Thus, there is a monotonic behaviour: when X is increased from zero to one, 
the resulting distortion D monotonically decreases, at the same time the 

10 resulting entropy H montonically increases. Immediately, an iterative 

algorithm can be derived from this monotonic behaviour. The parameter \ is 
initially set to X = 1, and the resulting entropy H is computed. If H is larger 
than the target bit rate Ho, the value of X is decreased in further iteration steps 
until the bit rate constraint, eq. (12), is fulfilled. While this iterative procedure 

15 forms the basis of a simplified distortion-rate method proposed for 
transcoding of Mrames, we continue to derive an analytical solution 
for X. 



After inserting the model pdf of Eqn. (19) in Eqns. (15) and (17), it can 
be shown that the basic equation (11) leads then to the analytical solution 
for X, 

25 



Eqns. (15) and (17) can be evaluated for the Laplacian model: 



20 





(20) 



with z = e'""^ and the 'z -entropy 
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h(z) = -z.logj z - (1-z), log//, z) 



(21) 



Eqn. (20) provides only an implicit solution for X, as the probability Pq 
on the right hand side depends on X according to eq. (13). In general, the 
value of Po can be determined only for known X by applying the quantiser 
characteristic of Eqns. (5) and (6) and counting the relative frequency of the 
event y= 0. However, eq. (20) is a fixed-point equation for X which becomes 
more obvious if the right hand side is described by the function 



10 



h(z) + (1-z). log 



(22) 



resulting in the classical fixed-point form X = g(^). Thus, it follows from the 
fixed point theorem of Stefan Banach that the solution for Xcan be found by 
15 an iterative procedure with 

Ayw -gaj) (23) 

in the (j + 1)-th iteration step. The iteration of (23) converges towards the 
20 solution for an arbitrary initial value Xo if the function g is 'self-contracting', i.e. 
Lipschitz-continuous with a Lipschitz-constant smaller than one. As an 
application of the mean theorem for the differential calculus, it is not difficult 
to prove that g is always 'self-contracting' if the absolute value of the partial 
derivative is less than one. This yields the convergence condition 



25 



1 > 



dg 
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A distortion-rate optimised quantisation method will now be derived 
based on the results obtained above. As an example, a technique is outlined 
for quantising the AC-coefficients of MPEG-2 intra frames. It is 
straightforward to modify this technique for quantising the dct-coefficients of 
5 MPEG-2 Inter frames, i.e. P- and B-frames. 

Firstly, one has to take into account that the 63 AC-coefficients of an 
8x8 dct-block do not share the same distribution. Thus, an Individual 
Laplacian model pdf according to eq. (19) with parameter ai is assigned to 
each AC-frequency index /. This results in an individual quantiser 
10 characteristic according to Eqns. (5) and (6) with parameter X-,. Furthemiore, 
the quantisation step-size q/ depends on the visual weight w-, and a 
frequency-independent qscale parameter as 



15 



Wi . qscale 
9, = — ^ (25) 



For a given step-size q/. the quantisation results in a distortion Di(X.i) 
and a bit rate Hi(Xi) for the AC-coefficients of the same frequency index /. As 
the dct is an orthogonal transform, and as the distortion is measured by the 
20 mean-squared-error, the resulting distortion D in the spatial (sample/pixel) 
domain can be written as 



D = Z^' (^0 (26) 

25 

With some positive normalising constant c. Alternatively the distortion can 
measured in the weighted coefficient domain in order to compensate for the 
variation in the human visual response at different spatial frequencies. 
Similarly, the total bit rate H becomes 



30 
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ZHi (XO 



(27) 



For a distortion rate optimised quantisation, the 63 parameters \, have to be 
adjusted such that the cost function 



D + ^.H (28) 

is minimised. The non-negative Lagrange multiplier m is determined by the bit 
rate constraint 



H <, Ho (29) 
Alternatively, if the distortion is expressed in the logarithmic domain as: 
D' = 20logioD dB (28a) 
15 The cost function to be minimised becomes: 



20 



25 



30 form 



B = D + M'H (28b) 

Where jj' is now an a priori constant linking distortion to bit rate. 

A theoretical argument based on coding white noise gives a law of 
6 dB per bit per coefficient. In practice, observation of actual coding results 
at different bit rates gives a law of k dB per bit. where k takes values from 
about 5 to about 8 depending on the overall bit rate. In practice, the intuitive 
'6dB' law corresponds well with observation. 

Additionally, the qscale parameter can be changed to meet the bit rate 
constraint of Eqn. (25). In principle, the visual weights wi offer another 
degree of freedom but for simplicity we assume a fixed weighting matrix as in 
the MPEG-2 reference decoder. This results in the following distortion rate 
optimised quantisation technique which can be stated in a 'C'-language-like 



wo 98/38800 



- 14- 



PCT/GB98/00582 



/* Begin of quantising the AC-coefficients in MPEG-2 intra frames*/ 



for {qscale = qmin; qscale < qmax; qscale = qscale + 2)/* linear qscale table*/ 



do{ 

Step 1; determine X^,X2, A-sa by minimising D + [i - H; 

Step 2: calculate H-ZHi (X/); 
M = |i + 5; /"S to be selected appropriately*/ 
}while(H>/yo); . 
Step 3: calculate D = c • Z D, (X/); 

if(0<Do»,){ 

qscaleopi = qscale; 

for (/ = 1 ; / ^ 63; / = / + 1 ) X/.^p/ = X,-; 
Om*. = D;} 



M = 0; 



for(/=1;/^63;/=/ + 1) 



. qscale^ 



opt 



16 



sgn (x) 



quantise all AC-coefficients of frequency-index / by 
} 

/*End of quantising the AC-coefficients in MPEG-2 intra frames*/ 
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There are several options for performing Step 1 - Step 3: 

1 . Options for performing Step 1 

The parameters Xi, X? ^63 can be determined 

5 a) analytically by applying Eqns. (20)-(23) of Section 3. 

b) . iteratively by dynamic programming of D + p • H, where either of the 
options described in the next points can be used to calculate D and H. 

2. Options for performing Step 2 

10 W = Z H/ (X,) can be calculated 

(a) by applying the Laplacian model pdf, resulting in 



15 



i i - Zi 



(32) 



where h{Poj) and h{Z,) are the entropies as defined in eq. (21) of Po,- (eq. 
(13)) and Z, = e'", respectively. Note that F^,,, in Eqn.(32) can be 
determined by counting for each dct-frequency index / the relative frequency 
20 of the zero-amplitude y - Q,(x) - 0. Interestingly, eq. (32) shows that the 
impact of the quantisation parameters X/ on the resulting bit rate W only 
consists in controlling the zero-amplitude probabilities Poj. 

b) from a histogram of the original dct-coefficients. resulting with Eqns. 
25 (10). (13) and (14) in 



^= -Z Z n - login (33) 
c) by applying the MPEG-2 codeword table 
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3. Options for performing Step 3 

D = c • Z D/ (X/) can be calculated 

5 

a) by applying the Laplacian model pdf of Eqn. (19) and evaluating 
Eqn. (16). 

10 b) by calculating D = E[(X' yf] directly from a histogram of the original 
dct-coefficients x. 

Depending on which options are chosen for Step 1 - Step 3. the 
proposed method results in a single pass encoding scheme if the Laplacian 

15 model pdf is chosen or in a multi pass scheme if the MPEG-2 codeword table 
is chosen. Furthennore, the method can be applied on a frame, macroblock 
or on a 8x8-block basis, and the options can be chosen appropriately. The 
latter is of particular interest for any rate control scheme that sets the target 
bit rate Ho either locally on a macroblock basis or globally on a frame basis. 

20 Furthermore, we note that the proposed method skips automatically 

high-frequency dct-coefficients if this is the best option in the rate-distortion 
sense. This is indicated if the final quantisation parameter Xi^opt has a value 
close to one for low-frequency indices / but a small value, e.g. zero, for high- 
frequency indices. 

25 A distortion-rate optimised quantisation method for MPEG-2 

compatible coding has been described, with several options for an 
implementation. The invention can immediately be applied to standalone 
(first generation) coding. In particular, the results help designing a 
sophisticated rate control scheme. 

30 The quantiser characteristic of eqs. (5) and (6) can be generalised to 

y = Q(x) = r(x) + L— + -^J . q(x) (34) 
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for non-negative amplitudes x. The floor-function LaJ in eq. (34) returns the 
integer part of the argument a. Negative amplitudes are min-ored. 



y = -Q(\x\) (35) 

The generalisation is reflected by the amplitude dependent values 
^ W. q(x), r(x) in eq. (34). For a given set of representation levels 
10 ... < rw < n < ri*i < ... and a given amplitude x, the pair of consecutive 
representation levels is selected that fulfils 

n., < X < r, (36) 

15 The value of the local representation level is then set to 

r(x) = r,., (37) 

The value of the local quantisation step-size results from 

g(x) = 9, = r, - r,., (38) 



20 



A straightfonward extension of the rate-distortion concept detailed 
above yields for the local lambda parameter, very similar to eq. (20) , 

25 



(39) 



(1 = 1 L) 

Similar to eqs. (13). (14), the probabilities in eq. (39) depend on the 
lambda parameters, 



30 
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P/ = j ;7rx;d>c / ^ 7 (41) 

5 Therefore, eq. (39) represents a system of non-linear equations for 

determining the lambda parameters X^, .... Xl. In general, this system can 
only be solved numerically. 

However, eq. (39) can be simplified if the term log2(PM/Pi) 
is interpreted as the difference 

0 // . = log,[^] (42) 

of optimum codeword lengths 



/; = .log^p, I,,, = -log,i>,,; (43) 

15 

associated with the representation levels n, tm. 

A practical implementation of the above will now be described. 
Once the probability distribution, parametric or actual, of the 
unquantized coefficients is known, it is possible to choose a set of quantizer 

20 decision levels that will minimise the cost function B, because both the 

entropy H and the distortion D are known as functions of the decision levels 
for a given probability distribution. This minimization can be performed off- 
line and the calculated sets of decision levels stored for each of a set of 
probability distributions. 

25 In general, it will be seen that the optimum value of X corresponding to 

each decision level is different for different coefficient amplitudes. In practice, 
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it appears that the greatest variation in the optimunn value of X with amplitude 
is apparent between the innermost quantizer level (the one whose 
reconstruction level is 0) and all the other levels. This means that it rnay be 
sufficient in some cases to calculate, for each coefficient index and for each 
5 value (suitably quantized) of the probability distribution parameter, two values 
of X, one for the innermost quantizer level and one for all the others. 

A practical approach following the above description is shown in 
Figure 5. 

The DCT coefficients are taken to a linear quantizer 52 providing the 

10 input to a histogram building unit 54. The histogram is thus based on linearly 
quantized versions of the input DCT coefficients. The level spacing of that 
linear quantizer 52 is not critical but should probably be about the same as 
the average value of q. The extent of the histogram function required 
depends on the complexity of the parametric representation of the pdf; in the 

15 case of a Laplacian or Gaussian distribution it may be sufficient to calculate 
the mean or variance of the coefficients, while in the 'zero excluded* Laplacian 
used in the Paper it is sufficient to calculate the mean and the proportion of 
zero values. This histogram, which may be built up over a picture period or 
longer, is used in block 56 as the basis of an estimate of the pdf parameter or 

20 parameters, providing one of the inputs to the calculation of X in block 58. 

Another input to the calculation of X is from a set of comparators 60 
which are in effect a coarse quantizer, determining in which range of values 
the coefficient to be quantized falls. In the most likely case described above, 
it is sufficient to compare the value with the innermost non-zero 

25 reconstruction level. The final input required to calculate X is the quantizer 
scale. 

In general, an analytical equation for X cannot be obtained. Instead, a 
set of values can be calculated numerically for various combinations of pdf 
parameters, comparator outputs and quantizer scale values, and the results 
30 stored in a lookup table. Such a table need not be very large (it may, for 
example, contain fewer than 1000 values) because the optima are 
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25 



not very sharp. 

The value of X calculated is then divided by 2 and added in adder 62 to 
the coefficient prior to the final truncation operation in block 64. 

Instead of using variable codeword lengths that depend on the cun-ent 
probabilities according to eq. (43). a fixed table of variable codeword lengths 
Co, -M Cl can be applied to simplify the process. The values of Co,..., Cl can 
be determined in advance by designing a single variable length code, ie. a 
Huffman code, for a set of training signals and bit rates. In principle, they can 
also be obtained directly from the MPEG2 variable-length code table. The 
only complication is the fact that MPEG2 variable-length coding is based on 
combinations of runs of zero coefficients terminated by non-zero coefficients. 

One solution to this problem is to estimate 'equivalent codeword 
lengths' from the MPEG2 VLC tables. This can be done quite easily if one 
makes the assumption that the probability distributions of the DCT 
coefficients are independent of each other. Another possibility is to consider 
the recent past history of quantization within the current DCT block to 
estimate the likely effect of each of the two possible quantization levels on the 
overall coding cost 

Then, eq. (39) changes to 

Mx) = Ai ^ J ' ^( Ci -C/.J .(1 = / L) (44) 

The resulting distortion-rate optimised quantisation algorithm is 
essentially the same as detailed previously except that the lambda 
parameters are calculated either from eq. (39) or eq. (44) for each pair of 
horizontal and vertical frequency indices. 

A simplified method of calculating X(x) will novy< be described, where 
only the local distortion is considered for each coefficient. 

Here, we make use of the fact that the variable-length code (VLC) 
table used for a given picture in MPEG2 is fixed and known. This should 
simplify and make more accurate the calculations of the trade-off between bit 
rate and distortion. In particular, the calculations can be made on a 
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coefficient basis since the effect on the bit rate of the options for quantizing a 
particular coefficient is immediately known. The same is true (although a little 
more difficult to justify) of the effect on the quantizing distortion. 

If we accept the assumptions implied in the above paragraph, then we 
5 can very simply calculate the value of the decision level to minimize the local 
contribution to the cost function B, This will in fact be the level at which the 
reduction in the bit count obtained by quantizing to the lower reconstruction 
level (rather than the higher level) is offset exactly by the corresponding 
increase in quantizing distortion. 
10 If the two reconstruction levels being considered have indices i and 

i + 1, the corresponding codewords have lengths Li, and Li*i, and the 
quantizer scale is q, then: 
(i) the reduction in bit count is Lj+i - U 

(il) the local increase in distortion is 20 logioq(1 - X/2) - 20 logioqX/2. 

15 

Combining these using the law linking distortion to bit rate, we have 

6(Ui-Li) = 20logio(2/X-1) (45) 

20 or, more simply 

Ui-Li = log2(2/X-1) (46) 

leading to 

25 A = 2/(1 + 2<L**'-i^)) (47) 

This elegant result shows that the value of X depends here only on the 
difference in bit count between the higher and lower quantizer reconstruction 
levels. 

30 The fact that the level of X is now independent both of the coefficient 

probability distribution and the quantizer scale leads to the following, much 



wo 98/38800 



- 22 - 



PCT/GB98/00582 



10 



15 



20 



simplified implementation shown in Figure 6. 

Here, the DCT coefficients are passed to the side-chain truncate 
block 70 before serving as the address in a coding cost fookup table 72. The 
value of lambda/2 is provided to adder 76 by block 74 and the output is 
truncated in truncate block 78. 

There have been described a considerable number of ways in which 
the present invention may be employed to improve quantisation in a coder; 
still others will be evident to the skilled reader. It should be understood that 
the invention is also applicable to transcoding and switching. 

The question will now be addressed of a two stage-quantiser. This 
problem is addressed in detail in the Paper which sets out the theory of so- 
called maximum a-posteriori (MAP) and the mean squared error (MSE) 
quantisers. By way of further exemplification there will now be described an 
implementation of the MAP and MSE quantiser for transcoding of MPEG2 
[MPEG2] intra AC-coefficients that result from an 8x8 discrete cosine 
transform (dct). 

The class of the first generation quantisers yi = Qi{x) specified by 
these equations is spanned by the quantisation step-size qi and the 
parameter Xi; such a quantiser is called (qi, Xi)-type quantiser. 

In the transcoder, the first generation coefficients yi are mapped onto 
the second generation coefficients y2 = Q2(yi) to further reduce the bit rate. 
Under the assumption of a (qi, Xi)-type quantiser in the first generation, eg. 
MPEG2 reference coder TM5 , it follows from the results set out in the Paper 
that the MAP quantiser Q2,map and the MSE quantiser Q2,mse can be 
implemented as a (q2, X2.map)-type and a (q2, A.2,mse)-type quantiser, 
respectively. For both, the MAP and the MSE quantiser, the second 
generation step-size is calculated from the second generation parameters 
W2 and qscale2. However, there are different equations for calculating A.2,map 

and ^2.mse. 



30 
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With the results of the Paper, it follows that X2.map can be calculated as 



^'i^ = /l2.r.f + iM^ ■ '^'^ • (48) 



5 and X2,insa as 



= 1 + - ^i) • ^ (49) 



The parameter A,2.ref can be changed In the range 0 ^ Xa.^^ 1 for 
10 adjusting the bit rate and the resulting signal-to-noise-ratio. This gives an 
additional degree for freedom for the MAP quantiser compared with the MSE 
quantiser. The value of X2,nf - 0.9 is particularly preferred. The parameter 
Pmap and the parameter \ima» are calculated from the first generation 
quantisation step-size qi and a z-vaiue, 



^ map 



2 1 • (l - In ( z"' ) ) . 2"' 



^■^ ' In ( 2"' ) • 1 . z'' 



(51) 



20 

The amplitude range of the values that result from these equations can 
be limited to the range 0 ^ M„ap. Mmse^ 2. Similarly, the amplitude range of 
the resulting values can be limited to 0 ^ X2,map, X2,mse^ 2. 

The z-value has a nomialised amplitude range, ie. 0 < z < 1, and can 
25 be calculated either from the first generation dct-coefficlents yi or from the 
original dct-coefficients x as described in the Paper. In the latter case, the z- 
value is transmitted as additional side information, eg. user data, along with 
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the first generation bit stream so that no additional calculation of z is required 
in the transcoder. Alternatively, a default z-value may be used. An individual 
z-value is assigned to each pair of horizontal and vertical frequency indices. 
This results in 63 different z-values for the AC-coefficients of an 8x8 dct. As a 
5 consequence of the frequency dependent z-values, the parameters Xj^ap and 
Kmse are also frequency dependent, resulting in 63 (q2, X2,map)-type 
quantisers and 63 (qj, X2,mse)-type quantisers, respectively. Additionally, 
there are different parameter sets for the luminance and the chrominance 
components. The default z-values for the luminance and chrominance 
10 components are shown in Table 1 and Table 2 respectively. 
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TABLE 1 

Normalised z-values, eg. 256 x z, for luminance (default) 





0 


1 


2 


3 


4 


5 


6 


7 


0. 




252 


250 


247 


244 


239 


233 


232 


1 


251 


249 


247 


244 


240 


235 


233 


231 


2 


249 


247 


245 


242 


238 


236 


234 


233 


3 


247 


245 


243 


240 


236 


235 


234 


233 


4 


246 


242 


239 


237 


235 


233 


232 


235 


5 


242 


238 


235 


234 


230 


229 


231 


233 


6 


237 


231 


226 


225 


222 


222 


226 


231 


7 


222 


211 


210 


205 


202 


208 


214 


222 
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TABLE 2 

Normalised z-values. ie. 256 x z, for chrominance (default) 





0 


1 


2 


3 


4 


5 


6 


7 


0 




248 


242 


230 


212 


176 


158 


179 


1 


246 


240 


233 


219 


193 


154 


156 


177 


2 


239 


233 


224 


209 


180 


148 


154 


173 


3 


229 


221 


211 


196 


163 


141 


150 


166 


4 


219 


208 


198 


181 


153 


133 


143 


166 


5 


207 


193 


182 


171 


140 


126 


143 


161 


6 


193 


176 


162 


154 


127 


118 


137 


163 


7 


169 1 


145 


148 


129 


102 


108 


127 


158 



For a description of preferred techniques for making available to 
subsequent coding and decoding processes, information relating to earlier 
coding and decoding processes, reference is directed to EP-A-0 765 576; 
EP-A-0 807 356 and WO-A-9803017. 
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Transcoding of MPEG-2 intra frames 
1. Introduction 

Transcoding is the key technique to further reduce the bit rate of a previously compressed im- 
age signal. In contrast to a standalone source encoder^ a transcoder has only access to a previ- 
ously compressed signal that already contains quantisation noise when compared to the 
original source signal Thus, the bit stream output of die traz\scoder is the result of cascaded 
coding with a so called first generation encoder in the first stage followed by the transcoder, 
see Fig.l. 



s 


enc-1 




transc. 







s s source signals enc-l ^ fiist generation encoder, transc. = transcoder 
, = first second generation bit stream 



Fig. 1: Cascaded coding as a result of first generation encoding and subsequent transcoding 



It is assumed throughout that the first generation bit stream bi that defines the input of the 
transcoder and the second generation bit stream b2 that represents the output are both MPEG- 
2 (MPEG-2] compliant. Hence, bj and b2 can be passed on to a MPEG-'2 decoder. In MPEG-2 
motion compensating prediction (mcp) is combined with the discrete cosine transform (dct) in 
a hybrid coding algorithm [TM5-93]. In general both elements, mcp and dct coding, can be ex- 
ploited for efficient transcoding. Compared to Inter frames, i.e. P* and B-frames, mcp is 
switched off in intra frames (I-frames). Therefore, only dct coding can be exploited to transcode 
I-frames. In this paper we concentrate on MPEG-2 compatible transcoding of I-frames. A gen- 
eralized block diagram of a MFEG-2 1-irame decoder is given in Fig. 2 
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'1(2). 



vld 


yi(2) 


idct 


— ► 



^1(2) 



vld =s variable length decoder^ idct = inverse discrete cosine transform 

bi(2) = fes^ (second) generation bit stream, yi(2) = decoded dct-coe£f. of first (second) generation 
Si^2) reconstructed image signals of first (second) generation 

Fig.2 : Generalized MPEG-2 1-frame decoder 

The corresponding first generation encoder and tnmscoder are detailed in Fig.3 and Fig.4, re- 
spectively. 



s 


dct 


X 


Qi 


Yi 


vie 






► 







dct ss discrete cosine transform, Qi = first generation quantiser, vie = variable length encoder 

s = original source signal, x « original dct-coeff., yi = dct-coeff . of first generation 
bi ~ first generation bit stream 



Fig. 3 : Generalized MFEG-2 compatible first generation I-frame encoder 



^ 

vld = variable length decoder, Q2 = second generation quantiser, vie = variable length encoder 

bi = first generation bit stream, = dct-coeff. of first generation 
b2 = second generation bit stream, yz = dct-coeff. of second generation 

Fig. 4 : Generalized MPEG-2 compatible I-frame transcoder 




As can be seen from Fig.4 the element of the transcoder to further reduce the bit rate is the sec- 
ond generation quantiser Q2 . Hence, the fundamental issue of transcoding is the design of Q2. 
To the author's knowledge, only a few publications have previously addressed this problem. 
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In [BT-94] and [Samo£f-96] it is suggested to implement in Q2 essentially the same quantiser 
characteristic that is used for Qi in the first generation encoder, Fig.3. In this case Qi and Q2 
have the same shape, e.g. a uniform quantiser characteristic, and differ only in their level of 
coarseness, i.e. the representation levels of Q2 are more widely spaced compared to the repre* 
sentation levels of Q^. Another approach to spediy Q2 is described in [CoIumbia-95]. Each 
DCT-coefficient y^ of the first generation is checked, and a decision is made whether to retain 
or skip it, i.e. y2 = Q2(yi)/ where either Q2(yi) = Yi or Q2(yi) = 0 holds. The decision whether to 
retain or skip is determined in a iterative optimisation procedure on a frame basis. Experimen- 
tal results given in [Columbia-95] indicate that, to a large extent, high frequency dct-coefficents 
are skipped and low frequency dct^oeffidents are retained. Therefore, this type of quantisa- 
tion results in dct-based low pass filtering, which in general carries the risk of introducing vis- 
ible block artefacts. Whilst this approach may be considered for transcoding for small bit rate 
changes between the first and the second generadon, it appears questionable whether skipping 
of dct<oefficients functions well in general Unfortunately, experimental results in [Columbia- 
95] are only given for transcoding between 4 and 3 Mbits/s, but not e.g. between 9 and 3 Mbit/ 
s. In [Samoff-96] the authors show in their experimental results that, even for transcoding be- 
tween 4 and 3 Mbit/s, skipping of dct-coef fidents is inferior compared with the above re-quan- 
tisation where Qx and Q2 have the same shape and differ only in their level of coarseness. 
However, different algorithms for skipping of dct-coeffidents have been used in [Samoff-96] 
and in [Columbia-95]. 

This paper provides a theoretical analysis of the transcoding problem. The formal description 
of the second generation quantiser Q2 indudes the suggestions mentioned above of [BT- 
94] [Columbia-95] [Samoff-96] as spedal cases. From the results of the analysis, we derive the- 
oretically the optimum quantiser characteristic Q2 for both the mean-squared-error (mse) cost 
function and a so-called maximum-a-posteriori (map) cost function. The difference between 
these two cost functions is explained, along with pointing out in which case each cost function 
is more suitable. In order to effidentiy apply the optimum mse- and map-quantiser character- 
istics in a traiTSCoder, it is necessary to model the statistics of the original dct-coeffidents x, see 
Fig.3, This paper proposes a parametric model. This model is first validated with real image 
data before it is used in the experiments to evaluate the mse- and map-quantiser characteris- 
tics. For reference, the results are compared with the performance of the quantiser characteris- 
tic of MPEG-2 test model TM5 fTM5-93]. 

The rest of the paper is organised as follows. In section 2, a formal desription of a MPEG-2 com- 
patible quantiser is introduced. Two examples suitable for the quantiser of a first generation 
encoder are discussed and compared. Section 3 focusses on the second generation quantiser Q2 
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used in the transcoder. The problem of designing is analysed by making a comparison to a 
reference quantiser Q2,rcf • The reference quantiser is used in a standalone encoder that by- 
passes the first generation stage and directly compresses the original signal to the desired bit 
rate of the second generation. In Section 4, two methods of desigrung Q2 are proposed, ex- 
plained, and compared. The first method minimises the mse cost function, the second minimis- 
es the map related costs. In Section 5 a parametric model to describe the statistics of the original 
dctKioefficients is introduced and validated with real image data. Based on this parametric 
model, an analytical evaluation for both the mse and the map cost function is carried out in 
section 6. Experimental results are discussed in section 7. Finally, conclusions and suggestions 
for future work are given in section 8. 

2. MPEG-2 compatible quantisation in a first generation encoder 

An MPEG-2 1-frame is partitioned into blocks of 8x8 samples of the original signal s. As shown 
in Fig.3, each block is submitted to the dct resulting in 64 dct-coeffidents x,- . The DC-coeffi- 
cient xo is separately quantised and encoded. As the DC-quantiser characteristic is fixed for 
each frame, we concentrate on the AC-coef£icients x, , i-l,2,...63, with amplitude range 
jjc^j < 1024 . Without loss of generality, the frequency index i can be fixed for the following dis- 
cussion. For clarity the frequency index i is therefore omitted. The original dct-coefficient x is 
passed to the first generation quantiser Qj. The MPEG-2 standard [MPEG-2] specifies in its 
normative part the set of representation leveb yj = Qi(x); in a MPEG-2 decoder, see Fig.2, a rep- 
resentation level yi is reconstructed as 

yj = /j -^j , (1) 

with the quantisation step-size 

^1 = 16 

The amplitude level li can take an integer value out of the allowed amplitude range |/ j | ^ 2047 , 
and is transmitted as (8x8)-block data in the first generation bit stream bj; bj includes as addi- 
tional side information the values of Wi and qscalei needed to calculate the quantisation step- 
size The value of Wi can be set for each frame and depends on the frequency index, thus 
taking into account the frequency dependent properties of human visual perception. The value 
of qscalei does not depend on the frequency index and can be changed on a macroblock basis 
within each frame. A macroblock consists of four luminance and two co-sited chrominance 
blocks, each of 8x8 samples. A MPEG-2 compatible quantiser complies with the reconstruction 
rules of (1) and (2). Additionally, yj has to be rounded to an integer which is onutted in our 
discussion to ease the notation. For a given step-size there is no imique MPEG-2 compatible 
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quantiser = Qi(x) because of the retnaizung degree of freedom how to map the set of original 
samples x onto the given set of representation levels. 



As an example, the quantiser characteristic can be specified for non-negative values "x as 



^4 

9i 2 



(?) 



where the floor function J extracts the integer part of the given argument a. The quantiser 
characteristic of (3) can be mirrored for negative values of 

The parameter in eq. (3) determines how the positive x-axis is partitioned into half-open in- 
tervals l^ip^ni^ J J ). Every interval is defined by two consecutive decision levels J ^ with 
= 0 for / = 0 and 



(5) 



for / > 1 . According to (3), each x e [d^^, + 1)^ ^ mapped onto the same representation 
level r^^ 



(6) 



see Hg. 5. 



''l(/ + l) ''l(/+l) ''l(/ + 2) 



Fig. 5: Decision and representation levels of the quantiser in eq. (3) 

The value of can be tuned to the cost function that is used to measure the quantiser per- 
formance. Here, two types of performance are corwiderecL 

(i) mse performance 

The mean-squared-error (mse) is a familiar cost function to measure the quanhser perform- 
ance. In this case the value of Xj is determined by minimising the expectation value 
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In order to minimise (7), each orginal dct-coefficient x has to be mapped onto the nearest rep- 
resentation level yi= r j ^ . Thus, without applying the calcixlus for differentiation one can con- 
clude: the corresponding decision levels d^^ that minimise (7) are defined by the arithmetic 
mean values 

^1/ 2 

for the given set of representation levels r ^ ^ . The result in eq. (8) can be regarded as the first 
half of the celebrated Uoyd-Max quantiser design rule described in [Lloyd-57] and [Max-60] 
which in its second half requires each representation level / to coincide with the local cen- 
troid of the corresponding bin i)) • However, the latter can in general not be 

achieved for the signal-independent representation levels of eq. (6) because the local centroids 
depend on the probability distribution of the original dct-coeffidents x, and are therefore sig- 
nal-dependent. With eqs. (6) and (8) it follows from eq. (5) that A.^ = 1 is the solution for the 
mse cost function. 

(ii) rate-distortion performance 

In a rate-distortion sense it is more suitable to minimise the mse term of eq. (7) subject to a giv- 
en bit rate constraint for the first generation bit stream bj. In this case the bit rate needed to 
encode the first generation dct-coeffidents yj is not allowed to exceed a preset value H. Let 
H^(X^) denote the resulting bit rate for an adjustment of the decision levels d^^ according to 
eq. (5). It then follows from the method of Lagrange multipliers [Heuser-82] that the optimum 
value of can be found by minimising the extended cost function 

^[(x-yi)^] + fi-//iaj). (9) 
The Lagrange multiplier ji in eq. (9) is determined by the constraint 

//,(Xj)<//. (10) 

There are two extreme cases. For /f « the Lagrange multiplier aproad\es zero, p. 0, and 
eq. (9) coinddes with eq. (7), i.e. no attention is paid to the resulting bit rate and only the nxse 
is minimised. For // 0 no dct-coeffdents yi can be coded. As a consequence, die dedsion 
level d^^ already approaches infinity for / = 1 , i.e. i/^ ^ « so that all original coeffidents x 
are quantised to zero. If the latter case with j *• is only applied to particular blocks or to 
a selected range of frequency indices, e.g. all high frequency dct-coefficients, then, the optimi- 
sation of eqs. (9) and (10) results in skipping of dct-coefficients. 
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The first twenty-five frames of the COR 601 test signal 'mobile' have been coded to evaluate 
both the mse and the rate-distortion performance of the quantiser specified in eqs. (3) and (4). 
Two values of A,^ have been used: a.) = 1 and b.) = 0.75 , The weighting matrix pro- 
posed in MPEG^2 test model TM5 [TM5-93] has been applied for a frequency dependent quan- 
tisation. Fig. 6 shows the resulting peak-signal-to-noise-ratio (PSNR) as a function of qscale^ , 
see eq. (2) for the meaning of qscale^. 



PSNR[dB] 




Fig. 6: PSNR/mse performance of the quantiser of eqs. (3) and (4) for the test signal 'mobile' 

In accordance with the flxeoretical results the largest PSNR values are achieved for « I . 
The PSNR values drop by about 0.4 dB if the value is changed to = 0.75 . However, 
X.^ = 0.75 is the better choice in tenns of rate-distortion performance for small and medium 
bit rates as is revealed in Fig. 7. For a given distortion of e.g. PSNR « 30 dB the resulting bit 
amount is approx. 450000 bit/frame in case of X J = 1 and approx. 410000 bit/frame in case of 
= 0.75 , this results in a bit saving of approx. 9% in the latter case. Conversely, for a given 
bit amount of 450000 bit/ frame the PSNR value can be increased by about 0.5 dB from 30 dB 
to 305 dB when changing from X| = 1 to X| = 0.75 . As explained above, when the bit rate is 
infinite, again the rate-distortion performance of X J = 1 is best. Hence, one can expect an in- 
tersection between the rate-distortion curves of Fig. 7 when the bit rate is increased. This is 
shov^ in Fig. 8. For bit rates larger than approx. 1 Megabit/frame which corresponds to PSNR 
values larger than 38 dB the results are in favour of X^ = 1 . However, the difference to the re- 
sult of X. = 0.75 is rather small. 
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PSNRCdB] 



Fig. 7: Rate-distortion performance in case of small and medium bit rates for 
the quantiser of eqs. (3) and (4), test signal 'mobUe' 
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Fig. 8: Rate-distortion performance in case of high bit rates for 
the quantiser of eqs. (3) and (4), test signal 'mobile' 
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The value = 0.75 is the 'intended' value for the quantiser of the MPEG-2 test model TM5. 
Due to a simplified calculation of eqs. (3) and (4) involving integer roimding operations^ the 
value of X| that is used in TM5 depends on the value of qscale^, for further details the reader 
is refered to the TM5 description in [TMS-93]. The functional relationship between and 
qscalex of TM5 is shown in Fig. 9. 




Fig. 9: MFEG-2 test model TM5, functional relationship between and qscalex 

For qscalex = 2 the resulting lambda value is X| = 1 , this is fine because a small qscalex value 
corresponds to a high bit rate, and then = 1 is the best choice. With increased qscalex the 
X| values approach the 'intended' value 0.75. This value is exactly matched, i.e. X j = 0.75 , if 
qscalei is a multiple of 4, e.g. qscalei = 4,8/12,16,... 

Of course, the experimental results give no evidence that Xj = 0.75 is the optimum value in 
the rate-distortion sense of eqs. (9) and (10). The tuning of X^ , or more generally, the adjust- 
ment of the decision levels for a given set of representation levels to improve the rate-distortion 
performance of the first generation quantiser is another issue and beyond this paper's scope. 
In the following sections we concentrate on the second generation quantiser and investigate 
how the degree of freedom that lies in the adjustment of the decision levels can be exploited 
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for efficient transcoding. 

3, MPEG-2 compatible quantisation in a tratiscoder • the transcoding problem 

In contrast to the first generation quantiser Qj that has access to the original dct-coeffidents x, 
the second generation quantiser Q2 used in the trax\scoder has only access to the first genera- 
tion dct<oefficients yj. Thus, Q2 maps the first generation dct-coefficients onto the second gen- 
eration. 

With 

yi=G,W (12) 

for the first generation quantiser, the relationship between the original dct-coeffidents and the 
second generation becomes 

Ideally, the result of cascaded quantisation in eq. (13) should be identical to the output of a ref- 
erence quantiser Qj^cef access to the original dct-coeffidents. 

The reference quantiser is used in a standalone encoder that by-passes the first generation 
stage and directly compresses the original signal to the desired bit rate of the second genera- 
tion. For ^2 = ^2 f ^ additional loss due to transcoding. 

Therefore, we start analysing the transcoding problem with the investigation for which cases 
3^2 = 3^2 y achievable. As an example. Fig. 10 shows the quantiser characteristics of the 
first generation and of the reference for transcoding. In this example, the two basic cases of 
transcoding occur. 
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Case 1: In the first case the half-open interval l^n^^m^i)) on the x-axis is considered. Each 
jc 6 (4 J ^, t/^^ _^ J J ) is mapped by the first generation quantiser onto the representation level 
yi^Q^M = ry. As a consequence, no matter on which second generation value this rep- 
resentation level is mapped by the transcoder's characteristic ^2 = QiiVi ^® resulting 
characteristic of eq. (13) will always be constant over the entire interval i /> ^ i( ; + i ) ) • How- 
ever, the reference quantiser of eq. (14) changes the representation level over the interval 
f^l/»^l(£+l)^ • Each ^^ii^^i^ref^ ^ mapped onto the representation level 
^2.r./ = 22,r./^^^''2(L..l)^^^^^^ ^ ^ l^L, re/' ^1(/ 1 ) ^ is mapped onto r^^ . The 
dilemma for the transcoder is that only the entire interval C^i /» (/ + j ) ) can be mapped ei- 
ther on r^^^ _ 1 ) or ''2L ' ^'^^^7' ™tter how tiie final choice is done, ^2 = ^2 ^ef ^ 
achievable for all X 6 t^'i/* j))* 

Case 2: In the second case the interval I^i (/ 1 )' ^1 (/ + 2) ^ on the x-axis is considered. In this 
case the reference quantiser maps the entire interval [^i (/ + j )» (/ 2) ^ on the representa- 
tion level . Hence, ^2 ^ >2 ref ^ ^'^^^^^^^ for all jc e I*' | (/ + i )• ^ i ( / + 2) ^ transcod- 
er applies the mapping 

'•2L = >2 = 22<>'l=''l (/+!)>• 
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Fig. 10: Quantiser characteristics of first generation and of the reference for transcoding 
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Case 1 must be avoided in order to fulfil = 'or the whole x-axis. This is accomplished 

if the set of decision levels {d^ ^^^} of the reference quantiser forms a subset of the set of de- 
cision levels / | generation quantiser^ 

For the parametric description of the decision levels in eq. (5), condition (16) can be translated 
into an equivalent condition that involves the quantisation step-sizes q | and of the first and 
the second generation, respectively^ 



J = LIL^ U = ike {1,2,3,...} . (17) 

«1 , \ref 
2 

Eq. (17) reads as follows. For given parameters and of the first generation and the 

reference quantiser, respectively, y2 = y^ is achievable for the whole x-axis if there exists 

a positive integer such that the middle term of (17) results in another positive integer k 

qi 

which at the same time has to be equal to the ratio — of the step-sizes. 

As an example, in the case of the mse cost function for ttte first generation and the reference 

q^ 

quantiser with = ^ re/ = 1 ' ^9- (1^) becomes — = (2 • nQ + 1) = k. This means that 

the ratio — has to be equal to an odd valued integer, e.g. 3, 5, 7, ... 

9i 

In general for arbitrary q ^ and q^ , condition (17) cannot be met, and as a consequence, there 
is an additional loss due to transcoding. This loss can be described by Case 1. It can be derived 
from Fig. 10 that the mismatch between y^ and y^ is especially large if the decision level 
ref coincides with the centre of the interval (^j/. i)) • For the above example of 

Xj = ^2. re/ - ^ this is indicated by an even ratio ^2^^ I ~ 2,4,6.... 

However, Case 1 does not occur throughout if eq. (17) is not fulfilled. The decision intervals of 

the first generation quantiser can be partitioned into two classes; those who belong to Case 1, 

e.g. (fij^,£i^^_j_ jj) in Fig. 10, and those who belong to Case 2, e.g. l^](/4. i)» ^i(/4.2)) 

Fig. 10. In general, the resulting two classes do not have equal number of assigned intervals. 

The percentage of intervals that belong to Case 1 depends on and q^ as well as on and 

^2 

^2 rtf * percentage of Case 1 intervals decreases asymptotically to zero as the ratio ~ 

tends to infinity, compare Fig. 10. Indeed, — = can be regarded as a special case of eq. (IT*) 

q J 

for Hq, it oo^ thus. Case 2 intervals are guaranteed throughout. For ?j >0 tiiis results in 
q^-o^ which can be interpreted as skipping of dct-coefficients in the transcoder and as well 
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in the reference quantiser. However, skipping of dct-coeffidents may not be the default for a 
sophisticated reference quantiser to achieve a good rate-distortion performance, e.g. a refer- 
ence quantiser defined by eqs. (3) and (4). Therefore, techniques are required that mmimise the 
additional loss due to transcoding in Case 1 intervals. This problem v^^ill be addressed in the 
following section. 

4. Design of the second generation quantiser Q2 used in the transcoder 

From the results of the previous section it follows that the mapping of eq< (15) should be ap- 
plied in the transcoder for Case 2 intervals. Therefore, this section concentrates on Case 1 in- 
tervals. Resuming the discussion of Case 1, the transcoder has to take a binary decision for the 
interval J j) in Fig. 10. As the interval [<fj^. ^/^^^ 2 j) is represented by the first 

generation level y^ = Q^(x) = rj^ in the transcoder, the decision is to map y^ = r^^ either 
onto the second generation representation level yj = ''2(L- 1) ^2 " '^IL' 

sion can be taken based on the minimisation of a cost function. Here^ two cost functions are 
considered. 

4.1 MSB cost function 

Similar to eq. (7) in section 3, the mean-squared-error (mse) cost function can be applied, re- 
sulting in the expectation value 

£[(x->2)^]- <18) 
Thus, the objective of this cost function is to nunimise the mse between the original dct-coeffi- 
dents X and the second generation coefficients yz that follow from the transcoder characteristic 
y^ = Qjiyi)^ For the mse cost function of eq- (18), the corresponding reference quantiser 
Q2 ref ^ defined by eqs. (3) and (4) with the parameter X^, ref = ^ second generation 

step-size . Hence, the decision level in Fig. 10 is related to the representation levels 

by eq. (8), i.e. 



As the transcoder has access to the first generation coefficients yj, this information can be ex- 
ploited to miiumise the term of eq. (18). Therefore, the mse cost function is expanded by intro- 
ducing a conditional expectation value that depends on yi, 

E[ix.y/] = £[£[U-y2)^|>',]]. (20) 
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With eq. (20) the resulting binary decision rule can be written for the Case 1 interval 



- ^2(L - l)>1^l] < 4^' - ''ZL^^h] 
'2(L - l)>1y l] > ^[(' - 'IlA^x] 

The conditional e^qiectation values in eq. (21) depend on the probability density function (pdf) 
pix) of the original dct-coeffidentsx. The pdf determines ttw probability F^^ that a single val- 
ue X falls in the interval [rfj^d^^^jj), and is mapped onto the first generation level 
yi = (2j(x) = r^i, 

P^^= J p{x)dx. (22) 
With the definition of a local centroid. 



^l(i+l) 

J {xp(x))Jx 



and the decision level of eq. (19), the decision rule of eq. (21) can be re-stated after a sbai^t- 
forward calculation as 



t'^U''^l(/ + l)^ in Fig. 10 as follows. 



f''2(L-l) 
y2 = e2^>'l = ^lP = | 



^ ^ * I '■2L '=\l^'^L.ref 

In the case of c^^ = ^/^^ in eq. (24), an arbitrary decision between r^^i^_ j ^ and can 
be made. However, the decision might then be in favour of the lower level, i.e. ''2(j[, _ i ) ' be- 
cause in general lower amplitude levels correspond to MPEG-2 codewords of smaller length. 
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4.1.1 Implementation of the mse cost fimction 

There are several ways to implement (24) in a transcoder. Here, we outline a straightforward 
implementation of the mse cost function as a quantiser characteristic = 62^^ 1 ^ * Given the 
first generation coefficient = r j ^ , the transcoder can compute the corresponding interval 
f^l r ''l + 1 ) ^ on the X-axis, e.g. for the first generation quantiser of eqs, (3), (4) one obtains 

and 

^i(/+i)==^i/-^^r ^26) 

In passing we note that the first generation quantiser step-size qj required in eqs. (25) and (26) 
has to be transmitted as side information in any MPEG-2 bit stream. However, the parameter 
is not specified in MPEG-2, and must therefore be additionally signalled, e.g. as user data in 
the first generation bit stream, see [MPEG-2] for the definition of user data. 

Having computed the interval [d^^, i)) ' corresponding second generation repre- 

sentation levels can be determined with the reference quantiser ^ef ^^S* 



Href^- 



^2. ref 



«2' 



(27) 



and 



^iq-H) , Href 
12 2 



•92' 



(28) 



withXj - I for the mse cost functicm. With eqs. (27) and (28), the coitesponding decision 

level d, , can be calculated from eq. (19). 
L, ref 

The pdf p(x) is needed to calculate the local centroid Cj^ according to eqs. (22) and (23). In 
order to save the amount of additional side information, the transcoder can apply a model de- 
scription for p{x) , involving only a few parameters. A parametric model suitable to describe 
the statistics of the original dct-coeffidents x will be detailed and validated in ttie next section 
5. 

Now, all parameters are avaUable,i.e. Tj^^.i) '^2L' ''l. re/ and c,^, to apply the decision 
rule of eq. (24). A more compact form of (24) in the sense of a quantiser characteristic can be 



SUBSTITUTE SHEET (RULE 26) 



wo 98/38800 




PCT/GB98/00582 



43 



Stated as follows. 



12 



(29) 



Eq. (29) specifies the second generation coefficient y2 as a function of the local centroid Cj^. 
However, as we are interested rather in the transcoder's quantiser characteristic >2 = 22(> j > ' 
the local centroid has to be related to the first generation coefficient y j . As in eq. (25), the local 
centroid c ^ ^ specified by a parameter p. ^ that relates the centroid to the decision level 



(Hi \ 



(30) 



Qearly, for P-^/ = 1 the local centroid coincides wiA die centre of the decision interval 
J ^ </ J ^ J p of length q J , From eqs. (25) and PO) one deduces 



^■4 



(31) 



After inserting (31) in (29) and by defining of 



^1 

l+Oii/-Xi)--. 



(32) 



^1 ^ 



^2- 



(33) 



one obtains the desired result. 

Thus, the transcoder's quantiser characteristic of eq. (33) is essentially the same as the one of 
the first generation of eq. (3). However, as can be seen from (32), the parameter ^2 is in general 
not a constant and depends on the actual value of p.^^ which can change with varying . 
Thus, in contrast to the first generation parameter , the second generation parameter de- 
pends in general on the actual input value of the transcoder's quantiser. 

Nevertheless, in special cases depending on the pdf p{x) , the parameter X2 become a con- 
stant, e.g. for a uniform pdf, i.e. p{x) = const, it follows from eqs. (22), (23) and (30) that 
ji^^ = 1 throughout, and as a consequence of eq. (32) ^2 becomes also a constant. Another 
special case with constant parameter ^2 occurs if p.^ ^ = ^.j holds in eq. (32). In this case each 
first generation coefficient y j coincides with the corresponding local centroid c ^ ^ , see eq. (31), 
resulting in = 1 for the second generation. 
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4.2 From the mse to the map cost function 

In addition to eq. (33), there is another instructive interpretation of the mse decision rule. We 
therefore have to re-state eq. (24) by substituting the local centroid c j ^ with the parameter fi j ^ 
according to eq. (30). After re-ordering one obtains 

«1 2 



With Fie. 10^ the term ^ ^ in eq. (34) can be interpreted as the a-posteriori probability 

P^^^ that the original dct-coeffident x falls in the interval [J^^, dj^ ^^^) given the first gener- 
ation coefficient = r^^ in the case of a uniform pdf p(x) = const over the interval 
t^W^l(/+l)^ of length i7^,Le. 



^fL^reCfii. (35) 



This is a curious result. Although the pdf p{x) is non-uniform in general, eq. (34) suggests one 
computes and compares this value with the threshold — . 



In general, the a-posteriori probability depends on the pdf as follows, 

"^L, ref 



(36) 



where the denominator P j ^ is defined as in eq. (22). The complementary a-posteriori proba- 
bility is given by 



For the special case of p(x) = const the a-posteriori probability P^^^ of eq. (36) becomes 
identical to of eq. (35). Also, the parameters Aat are related to the local centroids ti\en be- 
come [1 J ^ = I , throughout. Hence for this special case, the decision rule of eq. (34) can be re- 
stated with eqs. (36) and (37) as 
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'"^r (38) 



' P 

map ^ map 



In general for a non-uniform pdf, i.e. p(x) ^ const, the decision rule of eq. (38) does not coin- 
cide with the mse decision rule of eq. (34). The decision in (38) is based on the maximum a- 
posteriori (map) probabiUty which is either P^^^ or . Therefore, eq. (38) is called the 
map decision rule. 

Another important difference between the mse decision rxde of eq. (34) and the map decision 
rule of eq, (38) is that the reference quantiser ref ^ *® ™^ ^ ^ 

trary in the map case. Note that Q^^ determines the second generation decision level 
dj r in eqs. (36) and (37), and has therefore a significant impact on the a-posteriori proba- 
bilities. As an example, the map decision rule can be applied to ttie class of reference quantisers 
Q2 of eqs. (3) and (4) which is spanned by the parameter ^2^ In the special case of 

r = I, one obtains the reference quantiser of the mse cost function; however as ex- 
2, reJ 

plained earlier, the map decison rule will then only coincide with the mse decison rule if, ad- 
ditionally, the pdf is constant. 

The degree of freedom to select the reference quantiser for the map decision rule can be exploit- 
ed by specifying a characteristic 62 ref results in a sophisticated rate-distortion perform- 
ance. Thus, the map decision rule can take into accoimt not orJy the mse but also the resulting 
bit amount which is more suitable in a rate-distortion sense compared with the mse decision 
rule. 

As the mse decision rule of eq. (34) mininuses the cost function of eq. (18), one n:\ay now con- 
sider what cost function is minirrused by the map decision rule of eq. (38). It is not difficult to 
verify that the map decision rule minimises the cost function 

4(^2,„/-'2>']- 

where and are defined as in eqs. (13) and (14), respectively. Interestingly, it is again 

a mean-squared-error that we end up with. However, the mse of eq. (39) is more suitable in a 
rate-distortion sense than the mse of eq. (18). 

Finally in this section, we note that both the mse and the map cost function belong to the family 
of Bayesian cost functions [Melsa-CohnJ. 
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5. A parametric model to describe the statistics of the dct-coe£ficients 

The transcoder needs to know the pdf p(x) of the original dct-coeffidente x in order to apply 
both the mse and the map cost ftmctions. Basically, there are two possible approaches. In the 
first case, pix) is transmitted as additional side information along witii the first generation bit 
stream. Second, no additional side information is transmitted, and p(x) is estimated from the 
first generation dct<oeffidents . A parametric model is required that involves only a few 
parameters to limit the amoimt of additional side information in the first case. Also in the sec- 
ond case a parametric model with only a few parameters is needed because the reconstructed 
coeffidents y j may not cover a suffidcnt amplitude range and/or their number may not be 
suf fident to achieve a reliable estimate for many parameters; this problem is known as 'context 
dilution' [Rissancn et al. - 96]. In the following steps, a common parametric model will be de- 
rived that is suitable for both cases. 

In the first step, we propose to model p(x) as a Lapladan-like pdf 

which can be described by a single positive parameter a. A priori, the AC-coeffidents of an 
8x8 block cannot be assumed to share the same distribution. Therefore, an individual a value 
is specified for each AC-frequency index, resulting in 63 parameters in total. 

Due to the discrete nature of the dct-coefficients, the probability /"j/ to encounter a represen- 
tation level = ''i / = ' ' given by eq. (22). For the special case of = I , can be 
considered the probability of the original dctH:oeffdents x . A histogram for ten consecutive 
frames of the CCIR 601 test signal 'mobile' has been computed in order to check whether the 
parametric model of (40) is suitable for the original dct-coefficients x . Due to the symmetry as- 
sumption for positive and negative ampHtudes in eq. (40), the relative frequendes - of abso- 
lute amplitude levels |jc| = / have been measured, where 0^1^ 1024 and N = 10 x 6480 for 
each AC frequency index. The results are similar for all 63 AC frequendes, three examples for 
selected horiziontal and vertical frequency indices are shown in Fig. 11. Each curve has its 
maximum at W 3^=1 and decays rapidly with increasing /. The maximum at W = / = 1 
is larger and sharper peaked for higher frequendes, indicating a decreasing variance for in- 
creasing frequendes. Similar results have been obtained for other test signals. Qualitatively, 
the type of curve shown in Fig. 11 can be generated with eq.(40) by appropriate adjustment of 
the parameter a . 
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In order to get the best parameter fit one can take advantage of the fact that the trai\scoder 
needs to know the pdf p{x) only for x values that are mapped onto non-zero representation 
levels 9i 0 by the first generation quantiser. This is because the first generation coefficients 
y J =5 0 are always mapped onto the second generation coefficients ^2 " ^ - Hence, the pdf 
has to be modeUed only for |x| > ^ , where ^ is ttie smallest positive first generation deci- 
sion level. 




° 123456789 10 U 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 



Hg. 11: Histogram for absolute amplitude levels of original dct-coefficients 

for different horizontal and vertical frequency indices, test signal 'mobile' 



For the parametric description of eq. (5), one obtains cf J J = ^1 . In order to become 
independent of the first generation quantisation step-size , the value of d^^ can be set to 
, = f I V\.a . where o . is the smallest possible step-size that complies with eq, (2). 

11 I 2 J ^mtn ^tni/l 

Therefore, the pdf is modelled as 

p(x) = P p^(x) = p.f «-"'" .W^«/„ . (41) 
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The parameter (J in eq. (41) takes into account diat the integral jp(x)dx is smaDer than one 
when calculated only over the range \j^^d^^. The value of P can be used to match the condi- 
tion 

I p{x)dx = 1 - J p(x)dx = 1 - X = I -/o- (^) 

The right hand side of (42) is determined by the measured relative frequeiuies — of absolute 
values |x| = I that are commonly mapped onto y^ = 0 by the first generation quantiser. The 
latter is indicated in eq. (42) by the index /q which depends on the decision level y Thus, 
instead of calculating the sum 

/</q 

that appears in the right hand side of (42) one can also measure the relative frequency /q of 
the event = 0. 

It is important to notice that p is not needed to apply the parametric model of eq. (41) to bo* 
the mse and the map cost fvmction. During the calculation of the local centroids with eqs. (22) 
and (23), the value of p is cancelled out as it appears in the top and in the bottom line in eq. 
(23). Cancellation also occurs for the map cost function during the calculation of the a-posteri- 
ori probabilities of eqs. (36) and (37). Hence, only the value of a is needed in the transcoder. 
As a consequence, eq. (41) can provide a better fit for the curves shown in Fig. 11 than eq. (40), 
resulting in a more accurate estimate of the parameter a with no increase of side information. 

The probabUities P^^ can be evaluated for the parametric description of d\e decision levels of 
eq. (5) by inserting the parametric model of eq. (41) in eq. (22). After a straightforward calcu- 
lation that also takes into account condition (42) one obtains 

(|/|-1) -(a.^j) 

Pi/ = 5-(i-/o)-(^-^)'^^-nr '^-'^^^ = ' ^^^^ 

We recall that eq. (43) specifies the probability that one observes a first generation coefficient 
= ^ = i • It is interesting to notice that the first generation quantiser parameter X, is 
not needed in eq. (43) but only the step-size qi . Due to the symmetry assumption of the para- 
metric model (41) one gets = ^H-l) as a outcome of (43). For/ = 0 the probability is set 
toPio = /o.Thelargestindexin(43),i.e.L,canbesettothelargestpossiblevalueL =^ 1024 
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for AC-coef ficients or it may be set more accurately to the largest value that is actually encoun- 
tered in the transcoder. While eq. (43) forms the basis to estimate the parameter a from the 
first generation coefficients y j , we need a corresponding equation to estimate a from the orig- 
inal coefficients x. As already mentioned, the original dct-coeffidents result as a special case 
for the step-size 9i = 1 , i.e. x = = rj^ = / • 1 . When combined with condition (42), 
eq.(43) has to be modified as follows, 

Pu = ^(1-/0) (^-^)- Vio^i) '^^'o^ll^^ 

1-z 

As in the previous case, the probabilities for indices in the range |/| < /q that are not defined by 
eq. (44) can be set to the value of the corresponding relative frequencies of Ac original dct<o- 
efiidentsx. 

We first concentrate on estimating the parameter a according with eq. (43). Ideally, the model 
probabiUties /» ^ ^ of eq. (43) should coincide with the relative frequencies of the first gener- 
ation coefficients yj = rj^ = / that can be measured in the transcoder. However, there is 
only one free parameter in the model, i.e. a . Therefore, /-^ ^ = is in general not achievable 
for each index / . A coding argument can be used as a guideline for adjusting a . If the para- 
metric model of (43) were applied to encode the first generation coefficients , then the min- 
imum average codeword length cwl would be 

cwl is given in the unit 'bit per coefficient' if the logarithm is taken relative to the base of 2 in 
eq. (45). The right hand side of (45) specifies the (first order) source entropy ent which is the 
lower bound for cwl that can only be reached \lP^i = fi holds, throughout. The goal is now 
to adjust the parameter a of the probabilities Fj^ such that the resulting cwl is minimised and 
is as close as possible to the source entropy ent . It is hirther interesting to notice that cwl can 
also be written as 



cw/ = i-/,iog/'i, = 4iog''0'ii.yi2 y\N^' ^^^^ 

where P(y„. y^^ y^^j) specifies the joint probabiUty that results from the parametric mod- 
el (43) for all first generation coefficients y j arranged in some scan order y j j . > ] 2 > l A/ • ■^^ 

a consequence of (46), the minimisation of cwl by adjusting a coincides with the maximisa- 
tion of P(yii. y^fi) for the observed coefficients y^. y^^ "^"^ 

the parameter a is determined by a maximum likelihood (ML) estimation. 
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The ML-estimate for a can be calculated with ^^^^ = 0 . In order to simplify this calcula- 
tion, eq. (46) is evaluated by inserting the parametric model for F ^ ^ that results when the larg- 
est index L in eq. (43) tends to infinity. This is justified by the fact that in practice L is very 
large, e.g. L = 1024 . For L « ^ after differentiating and re-ordering one gets the equation 



In eq. (47) the value of a is indirectly given by z = « / see also eq. (43), and I speci- 

fies the xneasxired average value of the absolute first generation indices |/| , i.e. 

i = X|/|./^. (48) 

/ 

From eq. (47) one obtains the ML-estimate for a. 



Note that only the mean value I of eq. (48) and the relative fi:€quenc>'/o of the event >| =0 
have to be measured from the first generation coefficients to determine the ML-estimate of (49). 

One obtains a corresponding resvdt if the parameter a is not estimated from the first genera- 
tion coefficients but from the original dct-coefficients x . In this case eq. (44) instead of eq. 
(43) is used to derive the ML-estimate 

/-(i-/o)('o-i> 

where the mean value / is given by 

/= Z / J'. (51) 
I^Iq 

As introduced earlier the ratios ^ in eq. (51) specify the relative frequencies of the abolute val- 
ues |jc| = / , see also Fig. 11. The ML estimation of eqs. (50) and (51) coincides with the ML es- 
timation of eqs. (48) and (49) in the special case of ?j = = * • ^ general, one obtains 
different estimation values for the parameter a As more iriformation is provided by the orig- 
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inal dct-coefficients, the ML-€stimation with (50) and (51) is more accurate, however, the pa- 
rameter a has then to be signalled as additional side information. In ttus case it may be more 
convenient to signal z = rather than a because the z -values have a normalised ampli- 
tude range, i.e. 0 < z ^ 1 , so that each z -value can be rotanded to a fractional binary number of 
e.g. 8 bit length. In contrast to (50) and (51), the ML-estimation with (48) and (49) requires no 
additional side information that has to be sent to the transcoder. 

As an example, the parameter a has been estimated for each curve of Fig. 11 from the original 
dct-coeffidents x by applying eqs. (50) and (51). In order to determine the value of /q the de- 
cision level d^^ has been set according to 

resulting in 

'o - Pul - ^ 

where the hmction \ a \ rounds the given argument a up to the nearest integer. The resulting 
ML-estimate of z = e"*^ can be used for all ^jcaie^ -values that are larger or eqiial to 
qscale^-^ = 2 . According to eq. (53) the value of Iq depends only on the visual weight w, 
that changes with the horizontal and vertical frequency index of the AC-coeffidents. The 
weighting matrix of MPEG-2 test model TM5 has been used. Additionally, the estimated z -val- 
ues have been rounded to fractional binary numbers of 8 bit length. Figs. 12a - 12c show the 
resulting model probabilities of eq. (44) in comparison to the measured histograms of Fig. 11. 
Note that in Figs. 12a-12c the model probabilities for the absolute amplitude levels are shown, 
Le.Pi,^l = P,; + Pi^.^)for|/|>l. 
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Fig. 12 a: Model probabilities acc. to cq. (44) (solid line) and histogram (dashed line) 
for absolute amplitude levels of original dct-coeffidents, test signal 'mobile' 
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Fig. 12 b: Model probabilities acc. to eq. (44) (solid line) and histogram (dashed line) 
for absolute amplitude levels of original dct-coeffidents, test signal 'mobile' 
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Fig. 12 c: Model probabilities acc. to eq. (44) (solid line) and histogram (dashed line) 
for absolute amplitude levels of original dct«coefficients, test signal 'mobile' 

6. Evaluation of the mse and the map cost function for the parametric model 

In this section both the mse and the map cost function are evaluated for the parametric model 
of the pdf p(x) of eq. (41). The model parameter a can be estimated as described in the previ- 
ous section* In order to ease the comparison between the mse and the map cost function, the 
resulting decision rules of eq. (34) and (38) are considered, respectively. 

Firstly, the mse decision rule of eq. (34) is evaluated. The pdf p(x) determines the parameter 
|i J ^ that is related to the local centroid c j ^ according to eq. (30). The local centroid C| ^ can be 
calculated for the decision levels of eqs. (25) and (26) by inserting the parametric model of eq. 
(41) in eqs. (22) and (23). Without loss of generality a positive index I > 1 can be considered, 
the result can be mirrored for the corresponding negative index -/ . The calculus then yields 



J l-(l+ai7j)e 

^1/ = ^l/ + a -(a.^i) 
1-e 



-(agj) 



(54) 
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From eq. (30) one getscj^ = ^ll'^^'^l comparison with eq. (54) 

-(a ^i) 

_Lf - — i (55) 

2 " a.^j -(a-^j) 
1 ~e 



It follows from eq. (55) that the local centroid parameter ^ does not depend on the index / 
that is selected in the transcoder by the actual first generation coefficient >]'=^i/=^*^i' 
rather depends only on the estimated parameter a and the step-size that is decoded 
from the first generation bit stream. Hence, the Lapladan-like pdf defined by the parametric 
model of eq. (41) is another case that results in a constant parameter apart from die special 
cases already discussed in the last paragraph of Section 4.1-1. Consequendy, the parametric 
model of eq. (41) also reduces the complexity for implementing the mse decision rule in the 
transcoder. 

Secondly, the parametric model is evaluated for the map decision rule of eq. (38). After the 
computation of the a-posteriori probabilities of eqs. (36) and (37) for the decision levels of eqs. 
(25), (26) and the model pdf of eq. (41), the map decision rule of eq. (38) can be rewritten in a 
similar form to the mse decision rule of eq. (34), 



^2 = ^iC)-! = '"1/) = I ^ 



'"2(L-I) 
2L 



if 



thiefZhl^lk 
9l 2 



(56) 



The map-threshold in eq. (56) is given by 

2 a«, 



In 



-(a-^j) 



(57) 



where ln(a) returns the natural logariflun, i.e. logarithm relative to the base e, of the argU' 
ment a. 
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Thus we see that the map decision rule can be implemented in essentially the same way as the 
mse decision rule for the parametric model of eq. (41). The main differences are that the mse- 
threshold is defined by eq. (55) but the map-threshold by eq. (57), and that the decision levels 
dr f are fixed in the mse case but can vary depending on the reference quantiser in 
the map case as discussed earlier in Section 4.2, 

The same estimated parameter a can be applied to both the mse and the map cost functions. 
Therefore, the transcoder has the option to switch locally e.g. on a 8x8 block basis, between the 
mse and the map cost function with no furtfier increase of additional side information. 

7. Experimental results 

In order to verify the theoretical results derived in the previous sections, the transcoding set 
up of Figs. 3 and 4 has been simulated for ten consecutive frames of the CCIR-601 (CCIR-601] 
formatted test signal 'mobile'. As the MPEG-2 test model TM5 (TM5-93] is a widely acknowl- 
edged reference for a MPEG-2 standalone encoder, the first generation quantiser C j has been 
fbced to the TM5 quantiser characteristic throughout in the experiments. 

The trahscoder's quantiser characteristic has been set to TM5 in the first experiment. As an 
example, the corresponding qscale value has been fixed to qscale2 = 32 , which corresponds 
approximately to the adjustment in I-frames that is used for a 3 Mbit/s simulation including 
P- and B-frames. According to the linear qscale table of MPEG-2, the qscale value of the TM5- 
qxxantiser used in the first generation encoder has been varied in the range 
qscale^ = 2. 4, 6, 8, 32 . Thus, transcoding is simulated for different first generation bit 
rates and a fixed target bit rate for the second generation. The resulting PSNR values for the 
image signal reconstructed from the second generation bit stream ^2 shown in Fig. 13a 
as a function of qscale j . For reference, the solid line shows the resulting PSNR value of a stan- 
dalone TM5-encoder that by-passes the first generation and direcdy encodes the original sig- 
nal with a qscale value of 32. The Peak-Signal-to-Noise-Ratio is related to the mean-squared- 
crror between the original and the second generation signal as PSNR = 10 • log io[255 /mse] . 
In addition, Fig 13b conveys the bit amount needed to encode the second generation AC-coef- 
fidents with the MPEG-2 intra vie table. 
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PSNR [dB] 




Fig. 13a: PSNR of 2nd generation signal as a function of qscalci for fixed qscale2 = 32, 
TM5, lest signal *mobile* 



AC-bit acnounc per frame for MPEG-2 Incn VLC [bit] 




Fig. 13b: AC-bit amount of 2nd generation signal as a function of qscalej for fixed qscale2 = 32, 
TM5, test signal 'mobile* 

The PSNR values drop dramatically by more than 1 dB for medium values of qscakj in the 
range of 16-20 when compared to the reference. At the same time, the resulting bit amount 
changes considerably. In this case the resulting ratio qscale^/qscale j = ^2^^ i around 2, 
which is unfavourable for transcoding as explained during the discussion of eq. (17) in Section 
3. As an example, for qscalei = 20, the PSNR value is about 1.5 dB below the reference line while 
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the resulting bit amount is approximately (within 3%) the same for the reference and the trans- 
coded signal, see Figs, 13a, 13b. When qscaki is increased to 22, the PSNR value recovers and 
is only 0.1 dB below the reference line, however, now the bit amount dramatically exceeds the 
reference line by about 29%. These considerable changes between consecutive qscaUi values 
wotxld have the most unpleasant effect on any rate control scheme that is used in the transcod- 
er, thus resulting in a poor picture quality for the second generation. The PSNR value recovers 
when the qscaki value approaches qscaki, but the resulting bit amoimt is rattier high» For 
qscale^ = qseak2 = 32, transparency is achieved, i.e. the first and the second generation bit stream 
are identical. The TM5-quantiser provides the best results for small values of qscalcj in the 
range 2-8. Clearly, the first generation dct-coeffidents contain less quantisation noise when 
qsealei is small, and as a consequence, ttie difference between the second generation and the 
reference signal also becomes small. Similar results have been obtained for ottier test signals 
[OW-BBC-l]. 

In addition to the TM5 quantiser characteristic, the trariscoder has the option to apply the mse 
or the map cost function. The decision to select either of them may be based on the rate-distor- 
tion performance. While the resulting PSNR/mse-values can be estimated and compared in 
the transcoder by using the parametric model of eq. (41) for the pdf p{z) , it would be rather 
complex if the resulting bit amount had to be computed for each cost function by forming the 
MPEG-2 compatible two-dimensional (runlength/mplitudeheven^ of each 8x8 block and by 
looking up each codeword length from the intra vie table. It is less complex for the transcoder 
to calculate the first order source entropy, as in eq. (45)^ because only a histogram count for the 
second generation coefficients is then needed. Fig. 14a shows the bit amount for the MPEG-2 
intra vie of Fig. 13b scaled down for 8x8 blocks in comparison to the source entropy summed 
up for all 63 AC-coefficients. It can be seen that the two curves shown in Fig. 14a have essen- 
tially the same shape. This is confirmed if one calculates the ratio between them for each qscaki 
value, see Fig 14b. The ratio is almost constant, Le. 0.84. Thus, a comparison of the mse and the 
map cost function and the TM5 performance in terms of bit rate can also be carried out on the 
basis of the source entropy rather than by applying the MPEG-2 intra vie. Another interesting 
result of Fig. 14b is that up to approx. 16% of the bit rate could be saved by using the AC-en- 
tropy source model instead of the MPEG two-dimensional (runlength^mplitude) model. How- 
ever, this result cannot be exploited for MPEG-2 compatible bit streams. 
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MPEG-2 Intra VLC / AC-entropy per 8x8 block of 2nd generation (bit) 
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Fig. 14 a: Bit amount of 2nd generation AC coefficients: MPEG-2 Intra VLC vs. 
first order source entropy, test signal 'mobile' 
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Fig. 14 b: Bit amount ratio: First order source entropy over MPEG-2 Intra VLC 
(solid line), ratio =0.84 (dashed line), test signal 'mobile' 
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PSNR of 2nd generation [dB] 
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Fig. I5a: PSNR of 2nd generation signal as a function of qscalei for fixed qscale2 = 32; 

mse(upper line), mapA^^f = 0.90(niiddle line), TM5(dashcd line), test signal 'mobile* 



AC-entropy per 8x8 block of 2nd generation [bit] 




Fig. 15b: AC-entropy of 2nd generation signal as a function of qscalcj for fixed qscale^ = 32; 

mse(upper line), mapA2.rcf = 0.90(niiddle line). TM5(dashed line), lest signal 'mobile' 
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The mse and the map cost function have been simulated in the next experiment. The reference 
quantiser Q2 rtf "^"^ ^^^^ function complies to eqs. (3) and (4), as an example the deci- 
son level parameter has been set to \^ = 0.90 . The pdf parameter a has been estimated 
for each AC-frequency index as described in the example given in Section 5, see Figs. 12a-12c, 
with respect to the original dct-coeffidents, resulting in 63 x 8 = 504 bit additional side infor- 
mation. We recall that these a -values do not depend on the actual q^calti value as they are es- 
timated according to eqs. (52) and (53). Thus, the additional side information of 504 bit is the 
same for all first generation bit streams. A more accurate estimation of a is possible if the ac- 
tual ^scfltej value is inserted in cq. (52) instead of ^jfCfl/€„,.„ = 2; however, the additional side 
information would then depend on the first generation encoding process. 

A comparison of the cases where either the TM5 quantiser, the mse or the map cost function is 
used in the transcoder is shown in Figs. 15a and 15b. The mse cost hmction achieves the largest 
PSNR values, see Fig. 15a. For example in the case of qscalti = 20, the PSNR value can be in- 
creased by approx. 1.1 dB from approx. 25.6 dB for the TM5-quantiser to approx. 26.7 dB for 
the mse cost hmction. However, the mse cost function comes at a price as the entropy of the 
AC-coeffidents is significantly increased, see Fig. 15b. The mse cost function may therefore not 
be applicable throughout. However, the mse cost function can be used locally to transcode 
blocks with critical image content. As a harther option, the mse cost function can only be ap- 
plied to AC-coeffidents with low frequency index because the human visual system is in gen- 
eral more sensitive to quantisation noise that is added to low frequencies. 

The map cost function is more suitable in a rate-distortion sense compared with the mse cost 
hmction. For the critical case of qscalc j = 20 , the AC-entropy is approximately 4.7% smaUer 
and at the same time the PSNR value is approximately 0.4 dB larger in comparison to TM5, 
Figs. 15a and 15b show just one example for the map cost hmction. As the map cost function 
is governed by the parameter ^2 , a set of rate-distortion characteristics can be generated 
by varying thus allowing a smooth transition between the TM5-quantiser perform- 

ance and the i^e cost hmction in terms of PSNR and corresponding bit rate. The results for 
different values of in Figs. 16a and 16b show a monotonic behaviour: when is 

increased, both fl\e PSNR value and the AC-entropy are increased, too. 
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PSNR of 2nd generation (dBl 
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Fig. 16a: PSNR of 2nd generation signal as a function of qscalej for fixed qscale2 = 32; 
map cost function for different values of X^/ef • signal 'mobile' 
Xj^ref = 0.95 (upper line). 0.90, 0.85. 0.80. 0.75 (lower line) 



AC-entropy per 8x8 block of 2nd generation [bit] 




Fig. I6b: AC-entropy of 2nd generation signal as a function of qscalej for fixed qscale2 = 32; 
map cost function for different values of Xi^^f , lest signal •mobile* 
h rcf = 0-95 (upper line), 0.90. 0.85. 0.80. 0.75 (lower line) 
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In the last experiment the impact of estimating the pdf parameter a not from the original dct- 
coeffidents but from the first generation coefficients is investigated. No additional side infor- 
mation is necessary if a is estimated from the first generation coeffdents. A comparison be- 
tween the two methods is shown in Figs. 17a and 17b for the mse cost function. While the 
PSNR/mse performance in Fig. 17a is almost identical with and wiAout additional side infor- 
mation, one can see from Fig. 17b that the resulting bit amount is significantly higher in some 
cases without side information. Thus, not very surprisingly, the results are in favour of send- 
ing additional side information. This corudusion is not necessarily true for the map cost func- 
tion as shown for the example of X^^ = 0.90 in Figs. 18a and IBb. Similar to the mse cost 
function, the AC-cntropy is sig;nificantly higher for some qscalei values when no side informa- 
tion is sent (Fig. 18b), however, the resulting PSNR values also exceed the corresponding PSNR 
values for the case of additional side information. Thus, a good performance can be achieved 
even when no additional side information is sent to tite transcoder. 
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Fig. 17a: PSNR of 2nd gencraiion signal as a function of qscalei for fixed qscale2 = 32; 

mse cost function with and without additional side information, test signal 'mobile* 
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Fig. 17b: AC-entropy of 2nd generation signal as a function of qscalci for fixed qscale2 = 32; 
mse cost function with and without additional side information, test signal ^mobile' 
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Fig. 18a: PSNR of 2nd generation signal as a function of qscale | for fixed qscalca = 32; 
map cost function with and without additional side information, ^2^^ s 0.90« 
test signal 'mobile' 
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Fig. 18b: AC-entropy of 2nd generation signal as a function of qscale i for fixed qscalej = 32; 
map cost function with and without additional side information, T^^i^nf - 0*90, 
test signal 'mobile' 



SUBSTITUTE SHEET (RULE 26) 



wo 98/38800 



PCT/GB98/00582 



65 

8. Conclusions and future work 

This paper discusses transcoding of MPEG-2 intra frames. A theoretical analysis of the trans- 
coding problem is carried out with emphasis on designing the quantiser characteristic of the 
transcoder. The comparison witfi a reference quantiser of a standalone encoder shows that 
trai\scoding only results in an equivalent overall quantiser characteristic wder special condi- 
tions. This is indicated by the ratio of die first and the second generation quantisation step-siz- 
es. Only for certain ratios is the mapping of the original dct-coeffidents onto the second 
generation coefficients the same for the reference quantiser and the overall quantiser charac- 
teristic that results from transcoding. In general for an arbitrary ratio, the standalone reference 
quantiser characteristic cannot be achieved during transcoding. As a consequence, there is a 
loss due to transcoding when the mean-squared-error (mse) or the rate-distortion performance 
is considered. In order to minimise this loss, the degree of freedom that lies in selecting the de- 
cision levels for an MPEG-2 compatible quantiser can be exploited. 

Two approaches for the adjustment of the decision levels in the transcoder are proposed, ex- 
plained and compared. Firstly, the minimisation of the mse cost function is taken as a guideline 
for adjusting the decision levek. The objective of the mse cost function is to give the smallest 
mse values between the original and the second generation coefficients. The resulting mse de- 
cision rule can be implemented in the transcoder in essentially the same way as the first gen- 
eration quantiser characteristic. However, the mse cost function comes at a price as no 
attention is paid to the bit rate needed to encode the second generation coefficients. Therefore, 
the maximum a-posteriori (map) cost function is additionally introduced. The map cost func- 
tion is more suitable in a rate-distortion sense than the mse cost fimction. While the staundalone 
reference quantiser is fixed for the mse cost function, the map cost function has the additional 
freedom to choose the standalone reference quantiser. Thus, by changing the reference quan- 
tiser, a set of rate-distortion characteristics can be generated with the map cost function. Inter- 
estingly, the map cost function is again given by a mean-squared-error (mse); however in 
contrast to the mse cost function, the mse between the output of the standalone reference quan- 
tiser and the second generation coefficients is minimised. 

The statistical distribution of the original dct-coefficients is needed to apply both the mse and 
the map cost function in the transcoder. A parametric model based on a Laplacdan probability 
density function (pdf) is proposed. One parameter for each frequency component allows ad- 
aptation to the actual signal statistic. This parameter can be estimated either in the transcoder 
from the first generation coefficients or from the original dct-coefficients. In general, the latter 
results in a more accurate estimate, however, the parameter has then to be transmitted as ad- 
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ditional side information along with the first generation bit stream. For both cases, a maximum 
likelihood estimation rule is derived. The parametric model is validated with real Lcnage data; 
experimental results confirm that the model pdf is suitable for describing the distribution of 
the dct-coeffidents. 

The mse and the map cost function are evaluated for the parametric model. It is shown that the 
proposed model pdf also simplifies the implementation, and that the resulting mse and map 
decision rules can then be stated in very similar forms. 

Experimental results confirm the effectiveness of the mse and die map cost function. For refer- 
ence, the quantiser characteristic of the MFEG-2 reference encoder TM5 (TM5-93I has also been 
used in the transcoder. The results show large changes in terms of PSNR values and bit rate of 
the second generation coefficients for a ratio around two of the second and first generation 
quantisation step-sizes. The PSNR value can drop by about 1.5 dB while the bit rate remains 
constant or, conversely, the PSNR value remairw rattier constant while the bit rate is increased 
by almost 30%. This catxses problems for a rate controller that is used in the transcoder. The 
mse cost function achieves the largest PSNR values, resulting in up to 1.1 dB gain compared to 
TM5. However, the mse cost function also leads to the largest bit rates and may therefore only 
be applied locally to blocks with critical image content. As a further option, the mse cost func- 
tion can only be applied to AC-coeffidents with low frequency indices because the human vis- 
ual system is in general more sensitive to quantisation noise that is added to low frequencies. 

Experimental results show that in comparison to TM5, the map cost function can lead to a 
smaller bit rate (4.7 %) and at the same time to a larger PSNR value (0.4 dB) in critical cases, 
thus resulting in a better rate-distortion performance. By changing the reference quantiser of 
the map cost function, a set of rate-distortion characteristics can be generated allowing a 
smooth transition between the rate-distortion performance of the mse cost function and TM5. 
In the experiments, the class of reference quantisers is spanned by a single parameter; results 
show a monotomc behaviour in that an increase of the reference quantiser parameter leads to 
a larger PSNR value and to a larger bit rate. 

Experimental results confirm that for the mse cost function the estimation of tt\e pdf model pa- 
rameter from the original dct-coeffidents leads to a better rate-distortion performance than es- 
timating the model parameter from ti^e first generation coeffidents. This is not necessarily true 
for the map cost function, as revealed in one example. Thus, a good transcoding performance 
can also be achieved when no additional side information is transmitted along with ttie first 
generation bit stream. 
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It is further shown that the first order source entropy of the second generation coefficients can 
be used to derive an estimate of the bit rate that results from the MPEG-2 intra vie codeword 
table. This would siinpliiy the computation of the bit rate if the transcoder had to decide upon 
either the TM5, the mse or the map cost function based on the best rate-distortion performance. 
The resulting P5NR values can be compared in the transcoder on the basis of the Lapladan 
model pdf. This could be simplified for the map cost function due to the monotonic behaviour 
of the rate-distortion performance, e.g, after setting a target bit rate on a frame or block basis, 
the parameter of the reference quantiser can be increased until the first order source entropy 
exeeds the target bit rate. Hie investigation of an 'easy-to-implemenf algorithm based on the 
above rate-distortion considerations is a promising goal of future work. Furthermore, the pre- 
sented results can be adapted for transcoding of MPEG-2 inter-frames, Le. P- and B-frames, in- 
volving motion compensating prediction. However, the problem of drift [OW-94] [OW-96] 
between the predictors of the encoder and the decoder has then additionally to be taken into 
accotmt. 
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CLAIMS 

1. A method for compression encoding of a digital signal, including the 
steps of conducting a transformation process to generate values and 
quantising the values through partitioning the amplitude range of a 
value into a set of adjacent intervals, whereby each interval is mapped 
onto a respective one of a set of representation levels which are to be 
variable length coded, such that a bound of each interval is controlled 
by a parameter X, characterised in that X is controlled so as to vary 
dynamically the bound of each interval with respect to the associated 
representation level. 

2. A method according to Claim 1, wherein each value is arithmetically 
combined with X. 

3. A method according to Clarm lor Claim 2, wherein X is a function of 
the quantity represented by the value. 

4. A method according to Claim 3. wherein the transformation is a DCT 
and X is a function of horizontal and vertical frequency. 

5. A method according to any one of the preceding claims, wherein X is a 
function of the quantisation step size. 

6. A method according to any one of the preceding claims, wherein X is a 
function of the value amplitude. 

7. A method according to any one of the preceding claims, wherein the 
digital signal to be encoded has been subjected to previous encoding 
and decoding processes and X is controlled as a function of a 
parameter in said previous encoding and decoding processes. 
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8. A method according to Claim 7, having quantisation step size q = q2 
and a value of X = Xz, in which the value to be quantised has previously 
been quantised using a quantisation step size q = qi and a value of X 

= wherein A. is a function of qi and Xi . 

9. A method according to Claim 7 or Claim 8. wherein X is a function of 
Aref , where Xref is the value of X that would have been selected in a 
method according to Claim 1 operating with a quantisation step size 
q = q2 upon the value prior to quantisation with the quantisation step 
size q = qi. 

10. A method according to any one of the preceding claims, wherein the 
quantisation step size q is independent of the input value, othenA/ise 
than for the zero quantisation level. 

11. A (q, X) quantiser operating on a set of transform coefficients Xk 
representative of respective frequency indices fk in which X is 
dynamically controlled in dependence upon the values of Xk and fk 

12. A quantiser according to Claim 1 1 . wherein the parameters fk are 
frequency indices. 

13. A quantiser according to Claim 1 1 or Claim 12. in which X is 
dynamically controlled to minimise a cost function D + fxH where D is a 
measure of the distortion introduced by the quantisation in the 
uncompressed domain and H is a measure of compressed bit rate and 
|i is a constant determined by the bit rate constraint 
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14. In a compression transcoder, operating on a compressed signal 
quantised in first (qi, Xi)-type quantiser, a second (qz, X^-type 
quantiser in which the second generation X2 value is controlled as a 
function: 



15. A compression transcoder according to Claim 14 in which the 
parameter represents a notional reference (g^X^^xejr) -type 
quantiser which bypasses the first generation coding and directly maps 
an original amplitude onto a second generation reference amplitude. 

16. A compression transcoder according to Claim 14 in which the 
parameter Xz^x^t is selected empirically. 

17. A compression transcoder according to Claim 16 in which the 
parameter Xz.r^t is fixed for each frequency. 
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